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Abstract 

In  this  paper,  two  controllers  are  developed  for  a  class  of  MIMO  nonlinear  systems.  First,  a  robust  adaptive  controller 
is  proposed  and  proven  to  yield  semi-global  asymptotic  tracking  in  the  presence  of  additive  disturbances  and  parametric 
uncertainty.  In  addition  to  guaranteeing  an  asymptotic  output  tracking  result,  it  is  also  proven  that  the  parameter  estimate 
vector  is  driven  to  a  constant  vector.  In  the  second  part  of  the  paper,  a  learning  controller  is  designed  and  proven  to  yield 
a  semi-global  asymptotic  tracking  result  in  the  presence  of  additive  disturbances  when  the  desired  trajectory  is  periodic.  A 
continuous  nonlinear  integral  feedback  component  is  utilized  in  the  design  of  both  controllers  and  Lyapunov-based  techniques 
are  used  to  guarantee  that  the  tracking  error  is  asymptotically  driven  to  zero.  Numerical  simulation  results  are  presented  for 
both  controllers. 


Key  words:  Nonlinear  systems;  Adaptive  control;  Learning  control;  Disturbance  rejection 


1  Introduction 


It  is  the  case  of  a  class  of  MIMO  nonlinear  systems  with  parametric  uncertainty  and  bounded  disturbances  that 
is  considered  here.  Review  of  the  basic  control  problem  suggests  and  disqualifies  certain  solutions.  It  is  probably 
wise  at  the  outset  to  discard  an  exact  model-based  control  approach  for  this  problem  given  that  any  parameter 
estimation  error  and  disturbances  are  not  directly  addressed,  and  hence,  the  system  performance  and  stability 
cannot  be  predicted  a  priori.  Given  the  parametric  uncertainty  in  the  proposed  class  of  systems  to  be  studied,  an 
adaptive  control  solution  may  be  warranted.  However,  an  adaptive  controller  designed  for  a  disturbance  free  system 
model  may  not  compensate  for  the  disturbances  and  may  even  go  unstable  under  certain  conditions.  Enhancing  the 
adaptive  control  approach  with  a  robust  component  to  form  a  robust  adaptive  controller  can  generally  guarantee 
closed-loop  signal  boundedness  in  the  presence  of  the  additive  disturbances.  Unfortunately,  while  a  robust  adaptive 
controller  can  potentially  guarantee  the  convergence  of  the  tracking  error  to  a  bounded  set  {i.e.,  the  tracking  error 
can’t  necessarily  be  driven  to  zero)  the  asymptotic  tracking  result  (where  the  tracking  error  is  driven  to  zero)  that 
would  be  shown  for  an  adaptive  controller  applied  to  the  disturbance  free  model  will  be  lost.  These  trade-offs  in 
performance  and  robustness  have  framed  the  last  ten  years  of  research  in  robust  adaptive  control. 


*  This  paper  was  not  presented  at  any  IFAC  meeting.  A  preliminary  version  of  this  paper  appeared  in  [19].  Corresponding 
author  E.  Tatlicioglu.  Tel.  +90-232-7506728.  Fax  +90-232-7506599. 

Email  addresses:  envertatlicioglu@iyte.edu.tr  (Enver  Tatlicioglu),  xbin@tju.edu.cn  (Bin  Xian), 
darren.dawson@ces.clemson.edu  (Darren  M.  Dawson),  tburg@clemson.edu  (Timothy  C.  Burg). 
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Review  of  relevant  work  highlights  some  of  the  different  tacks  used  to  approach  this  problem.  An  adaptive  backstep- 
ping  controller  was  shown  by  Zhang  and  loannou  in  [23]  for  a  class  of  single-input/single-output  (SISO)  linear  systems 
with  both  input  and  output  disturbances.  The  proposed  controller  demonstrates  the  use  of  a  projection  algorithm  to 
bound  the  parameter  estimates  and  guarantees  an  ultimately  bounded  tracking  error.  In  an  alternate  approach,  the 
work  of  Polycarpou  and  loannou  [18]  demonstrated  a  leakage-based  adaptation  law  to  compensate  for  parametric 
uncertainties.  The  proposed  robust  adaptive  backstepping  controller  is  applicable  to  a  class  of  higher-order  SISO 
systems  with  unknown  nonlinearities.  The  suggested  control  law  guarantees  global  uniform  ultimate  boundedness  of 
the  system  state  (with  some  restrictions  on  the  bounding  functions  of  the  nonlinearities).  Robust  adaptive  control 
laws  were  developed  in  [4],  utilizing  the  modular  design  introduced  in  [11]  and  a  tuning  function  design,  for  a  class  of 
systems  similar  to  that  studied  in  [18].  These  authors  show  estimates  on  the  effect  of  the  bounded  uncertainties  and 
external  disturbances  on  the  tracking  error.  In  [7],  an  adaptive  backstepping  controller  for  linear  systems  in  the  pres¬ 
ence  of  output  and  multiplicative  disturbances  is  designed.  Ikhouane  and  Krstic,  added  a  switching  cr-modification 
to  the  tuning  functions  to  obtain  a  tracking  error  proportional  to  the  size  of  the  perturbations.  Marino  and  Tomei 
[15]  proposed  a  robust  adaptive  tracking  controller  that  achieves  boundedness  of  all  signals.  The  result  is  based  on  a 
class  of  SISO  nonlinear  systems  that  have  additive  disturbances  but  also  unknown  time- varying  bounded  parameters. 
It  is  significant  that  the  result  shows  arbitrary  disturbance  attenuation.  In  [16],  Pan  and  Basar  proposed  a  robust 
adaptive  controller  for  a  similar  class  of  systems  in  [15],  where  the  tracking  error  is  proven  to  be  /l2-bounded.  In  [5], 
Ge  and  Wang  proposed  a  robust  adaptive  controller  for  SISO  nonlinear  systems  with  unknown  parameters  in  the 
presence  of  disturbances,  which  ensure  the  global  uniform  boundedness  of  the  tracking  error. 


Most  of  the  research  in  adaptive  control  discussed  above  has  focused  on  the  convergence  of  the  error  signals  and 
boundedness  of  the  closed-loop  system  signals.  As  the  sophistication  in  adaptive  control  techniques  has  evolved, 
additional  questions  about  system  performance  have  arisen.  Notably,  the  final  disposition  of  the  parameters  estimates 
in  the  closed-loop  system  has  been  examined.  It  is  well  established  that  without  persistent  excitation  at  the  input, 
it  is  not  typically  possible  to  show  the  convergence  of  the  parameter  estimates  to  the  corresponding  system  values 
(with  an  exception  being  a  least-squares  algorithm).  In  fact,  for  gradient  and  Lyapunov-type  algorithms,  convergence 
to  a  constant  value,  is  typically  not  even  guaranteed.  Krstic  summarized  this  question  well  in  [10]  and  also  provided 
some  answers.  In  [10],  it  was  shown  that  for  the  proposed  adaptive  controller;  the  parameter  estimates  will  reach 
constant  values  after  a  sufficient  amount  of  time. 


A  recent  paper  by  Cai  et  al.  [2]  ^  presented  a  robust  adaptive  controller  for  MIMO  nonlinear  systems  with  parametric 
uncertainty  and  additive  disturbances.  It  was  assumed  that  the  disturbance  is  twice  continuously  differentiable  and 
has  bounded  time  derivatives  up  to  second  order,  the  proposed  controller  was  proven  to  yield  an  asymptotic  output 
tracking  result.  However,  no  mention  of  the  convergence  of  the  parameter  estimates  was  made.  Thinking  out  loud  for 
a  moment,  it  might  stand  to  reason  that  if  the  robust  part  of  the  controller  is  compensating  for  the  disturbances  and 
an  asymptotic  tracking  result  is  obtained  then  perhaps  something  special  is  happening  to  the  parameter  estimates. 
Exploring  this  vague  notion  with  mathematical  rigor,  we  will  show  that  with  a  minor  modification  to  the  control  in 
[2]  and  with  some  additional  analysis  of  the  stability  result,  we  are  able  to  formulate  a  new  conclusion  about  the 
parameter  estimates.  What  is  shown  is  that  this  robust  adaptive  controller  will  yield  constant  parameter  estimates 
even  in  the  presence  of  the  disturbance.  The  stability  analysis  parallels  that  presented  in  [2]  but  with  the  extended 
analysis  the  convergence  of  the  parameter  estimates  is  demonstrated.  In  the  design  of  the  adaptive  controller,  the 
robust  control  component  in  [20]  was  combined  with  an  adaptive  control  design  to  achieve  semi-global  asymptotic 
tracking.  One  contribution  of  this  paper  is  to  add  to  the  small  number  of  results  where  parameter  convergence  has 
been  shown.  In  the  second  part  of  the  paper,  a  learning  controller  for  the  same  class  of  MIMO  nonlinear  systems 
is  designed  under  the  assumption  that  the  reference  trajectory  is  periodic  (for  past  research  related  to  the  design 
of  learning  controllers,  reader  is  referred  to  [1],  [6],  [22]  and  the  references  therein).  In  the  design  of  the  learning 
controller,  the  robust  control  component  in  [20]  was  combined  a  with  nonlinear  learning  control  design  to  compensate 
for  the  unknown  system  dynamics  and  a  semi-global  asymptotic  tracking  result  is  obtained  in  the  presence  of  bounded 
additive  input  and  output  disturbances.  When  compared  to  [20],  the  two  control  methods  developed  in  this  paper 
require  less  control  energy.  The  adaptive  controller  includes  estimates  for  the  unknown  system  parameters,  and  the 
learning  control  design  embeds  a  learning  component  to  compensate  for  the  uncertain  system  dynamics  when  the 
desired  trajectory  is  periodic.  In  both  control  designs,  Lyapunov-based  techniques  are  used  to  guarantee  that  the 
tracking  error  is  asymptotically  driven  to  zero.  Numerical  simulation  results  are  presented  for  both  controllers  to 
demonstrate  their  viability. 


^  [2]  is  the  technical  report  version  of  [3]. 
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2  Adaptive  Control 


2.1  Problem  Statement 

Following  class  of  MIMO  nonlinear  systems  is  considered 

=/  +  G(u  +  di)  +  (i2  (1) 

where  (t)  G  M™,  i  =  0,  1),  are  the  system  states,  f  [x,x,  G  R™,  G  [x,x,  ...,x^^~^\6)  G 

]^mxm  nonlinear  functions,  6*  G  is  an  unknown  constant  parameter  vector,  di  (t) ,  c?2  (t)  G  R"*  are  unknown 
additive  nonlinear  disturbances,  and  u  (t)  G  R'"  is  the  control  input.  The  system  model  can  be  rewritten 

=  h  +  u  +  di  +  Md2  (2) 

where  M  {x,x^  ...,x^‘^~^\9')  G  and  h{t)  G  R™  are  defined  as 

(3) 

h  4  Mf.  (4) 

The  system  model  is  assumed  to  satisfy  the  following  assumptions. 

Assumption  1  The  nonlinear  function  G  (•)  is  symmetric,  positive  definite,  and  its  inverse  M  (•)  satisfies  the 
inequalities  [12] 

inUf<eMi-)^<rni-)Uf  G  R™  (5) 

fh  {x,  X, ...,  G  R  is  a  positive,  globally  invertible,  nondecreasing  function  of  each  variable,  mGM.  is  a  positive 

bounding  constant,  and  H-H  denotes  the  Euclidean  norm.  This  assumption  holds  for  most  electromechanical  systems. 

Assumption  2  The  nonlinear  functions,  f  (•)  and  G  (•),  are  continuously  differentiable  up  to  their  second  derivatives 
(z.e.,f{-),Gi-)GCV. 


Assumption  3  The  nonlinear  functions'^  ,  /(•)  and  M  (•),  are  affine  in  0. 

Assumption  4  The  additive  disturbances,  di  (t)  and  d2  (t),  are  assumed  to  be  continuously  differentiable  and 
bounded  up  to  their  second  derivatives  (i.e.,  di  (t)  G  and  di  (t)  ,di  (t)  ,di  (t)  G  Coo,  i  =  1,2/ 

The  output  tracking  error  ei  {t)  G  R™  is  defined  as 


ei  =  Xr  —  X 

where  Xr  {t)  G  R™  is  the  reference  trajectory  satisfying  the  following  property 

Xr  (t)  G  C”  ,  (t)  G  Coo  ,  i  =  0, 1, ...,  (n  +  2) . 


(6) 

(7) 


The  control  design  objective  is  to  develop  an  adaptive  control  law  that  ensures 


0  as  t 


oo,  i  = 


0, ...,  (n  —  1),  and  that  all  signals  remain  bounded  within  the  closed-loop  system.  To  achieve  the  control  objectives, 
the  subsequent  development  is  derived  based  on  the  assumption  that  the  system  states  (t),  i  =  0, ...,  (n  —  1)  are 
measurable. 


^  When  considering  mechatronic  systems  one  main  concern  in  regards  to  this  assumption  is  the  existence  of  friction.  The 
reader  is  referred  to  [14]  and  [17]  for  adaptive  controllers  that  considered  a  nonlinear  parameterizable  friction  model  which 
was  introduced  in  [13].  The  control  design  developed  in  this  paper  can  also  compensate  for  this  type  of  nonlinear  friction  by 
following  the  similar  steps  in  [17]. 
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2.2  Development  of  Robust  Adaptive  Control  Law 


The  filtered  tracking  error  signals,  Cj  ft)  €  M'",  f  =  2,  3, n  are  defined  as  follows 


62  =  ei  -b  Bi 

(8a) 

63  =  62  +  62  +  6i 

(8b) 

Bn  =  Bn-1  +  6n-l  +  6„-2- 

(8c) 

A  general  expression  for  e^,  f  =  2,  3, n  in  terms  of  ei  and  its  time  derivatives  is  given  as 


e,  =  J2<^rjei^  (9) 

3=0 

where  the  known  constant  coefficients  Oij  are  generated  via  a  Fibonacci  number  series^  [20],  [21],  To  facilitate  the 
control  development,  the  filtered  tracking  error  signal,  denoted  by  r  ft)  G  M'",  is  defined  by 

r  =  e„  +  Ae„  (10) 

in  which  A  G  is  a  constant,  diagonal,  positive  definite,  gain  matrix.  By  differentiating  (10)  and  premultiplying 

by  M  (•),  the  following  expression  can  be  derived^ 

Mr  =  M  ^  +  Ae„^ 

—  h  —  ii  —  di  —  Mc?2  —  Md2  (11) 

note  that  (6),  (9),  the  hrst  time  derivative  of  (2),  and  the  fact  that  a„^(„_i)  =  1  were  utilized.  The  expression  in 
(11)  can  be  arranged  as  follows 


Mr  =  --Mr  —  On  —  u  +  N  —  di—  Md2  —  Md2 


(12) 


where  the  auxiliary  function  N  {x,x,  ...,x^'^\f)  G  was  introduced  with  the  definition 


n-2 


Af  4  M  I  +  Ae„ 

3=0 


+M  (  1  +  Bn  —  h. 


1 


(13) 


To  facilitate  the  subsequent  analysis,  (12)  can  be  rearranged  as 


Mr  =  --Mr  —  Bn  —  u  +  N  +  Nr  +  'f 


(14) 


®  By  definition,  the  first  two  Fibonacci  numbers  are  0  and  1,  and  each  remaining  number  is  the  sum  of  the  previous  two  [9]. 
^  The  open-loop  error  system  in  (11)  is  developed  in  detail  for  a  second  order  system  in  Appendix  D. 
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where  N  (a;,  x, t)  ,  Nr  (t)  ,^{t)  €  R™  are  defined 


N=(^N-  Md2  -  Md2  ]  -  {Nr-  Mrd2  -  Mrd2 


Nr=  N\ 


X^Xr--,  X—Xr,---,  X'^''-’—X. 


)-0 


(n)— 3.(^) 


ll)  =  —di  —  Mrd2  —  Mrd2 
in  which  Mr  (t)  G  represents 


Mr  =  M\ 


(15) 

(16) 
(17) 


(18) 


Remark  1  By  utilizing  the  Mean  Value  Theorem  along  with  Assumptions  2  and  4,  the  following  upper  bound  can 
be  developed^ 


N{-)  <p(INII)lkll 


where  z  {t)  G  is  defined  by 


A 

2  = 


ef  Co  ...  et  r 


and  p{-)  G  R>o  is  some  globally  invertible,  nondecreasing  function. 

Remark  2  It  is  clear  from  (7),  Assumption  4,  (1V>  ^^6  time  derivative  of  (17)  that  f>{t),  i)  (t)  G  Coo- 

Remark  3  It  can  be  seen  from  (7),  (13),  (16),  and  the  time  derivative  of  (16)  that  Nr  (t).  Nr  (t)  G  Coo- 
Remark  4  In  view  of  Assumption  3,  Nr  (•)  defined  in  (16)  can  he  linearly  parameterized  in  the  sense  that 

Nr  =  WrO 

where  Wr  (t)  G  R™^^  is  the  known  regressor  matrix  and  is  a  function  of  only  Xr  (t)  and  its  time  derivatives. 
Based  on  (14)  and  (21),  the  control  input  is  designed  as 


'.  =  {K  +  I„ 


e„  (t)  -  e„  (to)  +  A  /  e„  (r)  dr 
■Ito 


(19) 

(20) 


(21) 


(22) 


(23) 


+  /  Wr  (r)  9  (r)  dr  +  n 

■Ito 

where  the  auxiliary  signal  11  (t)  G  R™  is  generated  according  to  the  following  update  law 

n  =  (Cl  +C2)Sgn(e„)  ,n(to)  =  Omxi 
where  9  (t)  G  R^  denotes  the  parameter  estimate  vector  and  is  generated  via 

9  =  r  f  IkJ  (r)  Ae„  (r)  dr  -T  f  (r)  e„  (r)  dr 

■Ito  -Ito 

+VWj  (t)  e„  (t)  -  TWj  (to)  e„  (to) .  (24) 

In  (22)-(24),  K,  Ci,  C2  G  p  ^  Rpxp  constant,  diagonal,  positive  definite,  gain  matrices,  Im  G  R™x”j.  jg 

the  standard  identity  matrix,  and  Sgn(-)  G  R™  being  the  vector  signum  function.  It  should  be  noted  that  d  (to)  =  Opxi 


The  reader  is  referred  to  Appendix  F  for  the  derivation  of  the  upper  bound  in  (19). 
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and  u{to)  =  Omxi  where  Opxi  G  and  Omxi  G  K™  are  vectors  of  zeros.  Based  on  the  structure  of  (22)-(23),  the 


following  are  obtained® 

u=iK  +  I^)r+  {Cl  +  C2)  Sgn  (e„)  +  WrB  (25) 

d  =  VWjr.  (26) 

Finally,  after  substituting  (25)  into  (14),  the  following  closed-loop  error  system  for  r  (t)  is  obtained 
Mr  =  -  Cn  -  {K  +  Im)  r  -f  Wr'6 

-(Ci+C2)Sgn(e„)  +  iV  +  V’  (27) 

where  the  parameter  estimation  error  signal  0  (t)  G  W  is  defined  as  follows 

9  =  9-6.  (28) 


2.3  Stability  Analysis 


Theorem  1  The  control  law  (22),  (23)  and  the  update  law  (24)  ensure  the  boundedness  of  all  closed-loop  system 


signals  and 


it) 


0  as  t  ^  00,  z  =  0, ...,  n,  provided 


Amin  (A-)  >  2  ) 


1 


(29) 

(30) 


Cu  >  Ui  (0llz:„„  +  ^  p*  it)\ 

where  the  subscript  z  =  1,  ...,m  denotes  the  ith  element  of  the  vector  or  diagonal  matrix  and  the  elements  of  K  are 
selected  sufficiently  large  relative  to  the  system  initial  conditions  (see  Appendix  A  for  proof). 

Theorem  2  There  exists  a  constant  vector  9 00  G  such  that 

9  (t)  ^  9oo  as  t  ^  00  (31) 

(see  Appendix  B  for  proof). 

2.4  Numerical  Simulation  Results 

A  numerical  simulation  was  performed  to  demonstrate  the  performance  of  the  adaptive  controller  given  in  (22)- (24). 
A  first  order  form  of  the  class  of  systems  considered  in  this  paper  ^  with  the  following  modelling  functions  is  utilized 
[2] 


/= 

a;iX2 

..,2 

,  G  = 

■  2  -1-  cos  xi 
9i 

0 

3  -I-  sin  X2 

X2 

0 

92  \ 

1 

1 _ 

1 

to 

_ 1 

1 - 

10 

Ld 

di  — 

d2  = 


COS  (2t)  -|-  exp  (— 0.5t) 
sin  (3t)  -I-  exp  (— 0.5t) 
sin  (2t)  -I-  exp  (— 0.5t) 
cos  (3t)  +  exp  (— 0.5t) 


®  The  expressions  in  (22),  (23)  and  (25)  are  based  on  [20]  and  [21]. 

^  The  system  model  utilized  in  this  simulation  study  is  presented  in  detail  in  Appendix  E. 
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where  x  = 


Xi  X2 


.  The  reference  trajectory  was  selected  as 


X'pI 

Xr2 


The  initial  conditions  of  the  system  were  set  to  x  (to)  =  2—1  and  0  (to)  = 


sint 

-  exp  1 

cost 

^1  —  exp 

(to) 

=  [2  -1 

'  5 
’  2 


iT 


0  0  ,  while  the  controller 


parameters  were  chosen  as  A  =  4/2,  K  =  2/2,  Ci  =  2/2,  C2  =  2/2,  and  T  =  2OO/2.  The  controller  parameters  above 
were  selected  via  a  trial-error  method  until  a  good  tracking  performance  was  obtained  and  then  the  lower  control 
gain  value  was  preferred.  The  tracking  error  ei  (t)  is  presented  in  Figure  1  where  it  is  clear  that  the  tracking  objective 
is  satisfied.  In  Figures  2  and  3,  the  parameter  estimate  9  (t)  and  the  control  input  u  (t)  are  presented,  respectively. 
From  Figure  2,  it  is  clear  that  the  parameter  estimate  vector  is  driven  to  a  constant  vector. 


To  demonstrate  the  effect  of  the  adaptive  term  J^^Wr  (t)  9  (t)  dr  in  the  adaptive  controller  in  (22),  during  the 
simulation  run  following  performance  measures  were  computed 


Me(t)^  f\\eiiT)fdT  (32) 

Jto 

Mu{t)=  f  ||■u(T)||^(^T  (33) 

Jto 

where  Me  (t)  is  a  measure  of  the  magnitude  of  the  tracking  error,  and  (t)  is  a  measure  of  the  energy  expended 
by  the  controller  over  a  period  of  the  operation  of  the  system.  For  both  runs,  it  was  observed  that  the  tracking  error 
converged  to  zero  within  4  seconds.  From  Table  1,  it  is  clear  that  after  adding  the  adaptive  term,  the  controller 
required  less  energy  while  achieving  improved  tracking  performance. 

Table  1 

Comparison  of  Energy  Measures  for  Adaptive  Control 


u  (t)  without 

u  (t)  with 

IL  ^  (^) 

IL  (^)  ^ 

Me 

1.5559 

1.4611 

Mu 

49.1676 

47.8269 

Time  [sec] 

Fig.  1.  (Adaptive  Controller)  Tracking  Error  ei  (t) 
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Fig.  2.  (Adaptive  Controller)  Parameter  Estimate  9  (t)  (top  plot  is  6i  (t)  and  the  bottom  one  is  62  (t)) 


Fig.  3.  (Adaptive  Controller)  Control  Input  u  (t) 


3  Learning  Control 

3.1  Problem  Statement 

The  system  model  in  (1)  is  considered.  The  nonlinear  functions  G  R™  and  G{x,x,  G 

]^mxm  uncei-tain  where  this  dynamic  uncertainty  is  assumed  to  be  non-parameterizable.  The  system  model  is 
assumed  to  satisfy  Assumptions  1,  2,  and  4. 

The  output  tracking  error  ei  (t)  is  defined  in  (6)  and  in  this  case  the  reference  trajectory  is  periodic  in  the  sense  that 

(t  +  T)  =  (t)  ,  x^*^  (t)  G  £00,  *  =  0, ...,  (n  +  2)  (34) 

where  T  G  R."*"  is  the  period  of  the  reference  trajectory. 

The  control  design  objective  is  to  develop  a  nonlinear  control  law  that  ensures  ||ei  {t)\\  ^  0  as  t  ^  00.  To  achieve 
the  control  objective,  the  subsequent  development  is  derived  based  on  the  assumption  that  the  system  states  x^*^  (t), 
1  =  0, ...,  (n  —  1)  are  measurable. 
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3.2  Development  of  Learning  Control  Law 

The  open-loop  error  system  development  for  the  learning  control  law  is  exactly  the  same  as  the  open-loop  error 
system  development  for  the  adaptive  control  law.  The  control  design  is  assumed  to  continue  after  Remark  1. 

Remark  5  Lt  can  he  deduced  from  (34),  Assumption  4,  (IV^  o,nd  the  time  derivative  of  (17)  that  ip  (t),  ^p  (t)  G  Coo- 

Remark  6  It  can  be  seen  from  (13), (16),  (34),  and  the  time  derivative  of  (16)  that  Nr  (t) ,  Nr  (t)  G  Coo- 

Remark  7  After  utilizing  ( 34 ),  it  is  clear  that  Nr  (t)  satisfies  the  following  equation 

Nr  (t  +  T)=  Nr  (t)  .  (35) 


Based  on  (14),  the  control  input  is  designed  as 


u={K  +  Im)  e„  (f)  -{K  +  Im)  e„  (to)  +  (t) 


+  f  (K  +  Im)  Ae„  (r)  dr  +  11 

-Ito 


where  the  auxiliary  signal  11  (t)  G  ffi.™  is  generated  according  to  the  following  update  law 


n  =  C'iSgn(e„)  ,n(to)  =  Omxl 


(36) 


(37) 


and  Wr  (t)  G  M*”  is  defined  as  follows 

Wr  (t)  =  Wr  (t  -  T)  +  LlA  f  e„  (r)  dr 

J  tQ 

+kLen  (t)  -  kLCn  (fo)  ■  (38) 

In  (36)-(38),  K,Ci,A  G  are  constant,  diagonal,  positive  definite,  gain  matrices  and  kr  G  M.  is  a  positive  gain. 

It  should  be  noted  that  since  Wr  (to)  =  Omxi  it  follows  that  m  (to)  =  Omxi-  The  auxiliary  function  Nr  (t)  G  R™  is 
defined  as 

Nr  =  Wr.  (39) 

By  utilizing  (39)  along  with  (38),  the  following  can  be  obtained 

Nr  (t)  =Nr{t-T)  +  krr  (t) .  (40) 

Taking  the  time  derivative  of  (36)  and  substituting  from  (37)  and  (39)  generates® 


ii  =  {K  +  Im)r  +  CiSgn  (cn)  +  Nr  (t)  ■  (41) 

Finally,  after  substituting  (41)  into  (14),  the  closed-loop  error  system  for  r  (t)  is  obtained  as  follows 

Mr  = -^ilr  -  Cn  -  {K  +  Im)r  (42) 

-CiSgn  (e„)  +  TV  +  iV,  +  V- 

where  Nr  (t)  G  R.™  is  dehned  as 

Nr  =  Nr  -Nr-  (43) 

By  utilizing  (35)  and  (40),  Nr  (t)  can  be  rewritten  as 

Nr  (t)  =Nrit-T)-  krr.  (44) 

®  The  expressions  in  (36),  (37)  and  (41)  are  based  on  [20]  and  [21]. 
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3.3  Stability  Analysis 

Theorem  3  The  control  law  (36)  and  (38)  ensures  that  ||ei  (i)|j  ^  0  os  i  ^  oo,  provided  that  (29)  and  (30)  are 
satisfied  and  the  elements  of  K  are  selected  sufficiently  large  relative  to  the  system  initial  conditions  (see  Appendix 
C  for  proof). 

3.4  Numerical  Simulation  Results 

A  numerical  simulation  was  performed  to  demonstrate  the  performance  of  the  learning  controller  given  in  (36)- (38). 
The  first  order  system  model  in  Section  2.4  is  utilized  with  the  following  reference  trajectory 


Xrl 

sin  (0.27rt)  1 

Xr2 

CM 

0 

0 

_ 1 

(45) 


The  initial  conditions  of  the  system  were  set  to  x  (to) 


1 


while  the  controller  parameters  were  chosen  as 


A  =  20/2,  K  =  I2,  Cl  =  4/2,  and  kL  =  200.  The  controller  parameters  above  were  selected  via  a  trial-error  method 
until  a  good  tracking  performance  was  obtained  and  then  the  lower  control  gain  value  was  preferred.  The  tracking 
error  ei(t)  is  presented  in  Figure  4.  From  Figure  4,  it  is  clear  that  the  tracking  objective  is  satisfied.  In  Figure  5,  the 
control  input  u  (t)  is  presented. 


To  demonstrate  the  effect  of  the  learning  term  Wr  (t)  in  the  learning  controller  in  (36),  during  the  simulation  run 
the  performance  measures  in  (32)  and  (33)  were  computed.  For  both  runs,  it  was  observed  that  the  tracking  error 
converged  to  zero  within  5  seconds.  From  Table  2,  it  is  clear  that  after  adding  the  learning  term,  the  controller 
required  less  energy  while  achieving  improved  tracking  performance  (z.e.,  faster  convergence). 

Table  2 

Comparison  of  Energy  Measures  for  Learning  Control 


u  (t)  without  IVr  (t) 

U  (t)  with  Wr  (t) 

Me 

0.83 

0.13 

M„ 

35.14 

41.97 

-0.6 

-0.8 


.ll - ^ ^ ^ ^ ^ ^ ^ ^ ^ - 1 

0123456789  10 


1.5 


0.5  \ 

Q 1-^  -  I  I  I  I  I  I  I  I  I 

0123456789  10 


Time  [sec] 


Fig.  4.  (Learning  Controller)  Tracking  Error  ei{t) 


4  Conclusion 

Two  controllers  were  developed  for  a  class  of  MIMO  nonlinear  systems  in  the  presence  of  additive  disturbances.  The 
robust  adaptive  controller  was  proven  to  yield  a  semi-global  asymptotic  tracking  result  in  the  presence  of  parametric 
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-5 1 


-10  - 

-15 1 - ^ ^ - ‘ - ^ ^ ^ ^ - ‘ - ^ - 

0123456789  10 


Fig.  5.  (Learning  Controller)  Control  Input  u{t) 

uncertainty  along  with  additive  disturbances.  The  adaptive  controller  and  the  adaptation  law  were  designed  such 
that,  the  parameter  estimate  vector  is  proven  to  go  to  a  constant  vector.  In  the  second  part  of  the  paper,  the 
learning  controller  was  proven  to  yield  a  semi-global  asymptotic  result  in  the  presence  of  additive  disturbances  and 
when  the  desired  trajectory  is  periodic.  In  the  development  of  both  controllers,  the  bounded  additive  disturbances 
were  assumed  to  be  twice  continuously  differentiable  and  have  bounded  time  derivatives  up  to  second  order.  Since 
no  assumptions  were  made  regarding  the  periodicity  of  the  disturbances,  it  is  clear  that  the  suggested  controllers 
compensate  for  both  repeating  and  nonrepeating  disturbances.  For  each  controller,  Lyapunov-based  techniques  were 
used  to  prove  the  tracking  result.  Numerical  simulation  results  were  presented  for  both  controllers  where  nonrepeating 
disturbances  were  utilized. 
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A  Proof  of  Theorem  1 

Lemma  1  Let  the  auxiliary  functions  Li  (t),  L2  (t)  G  M  6e  defined  as  follows 

Li  =  r'^  {-tp  -  CiSgn{en))  ,  L2  = -AC2Sgn{en)  ■  (A.l) 

If  C\  is  selected  to  satisfy  the  sufficient  condition  (30),  then 

ll  -  ‘^bi  .  ft*  L2  (r)  dr  <  Ch2  (A-2) 

where  ^62  G  ®  bire  positive  constants. 


PROOF.  After  substituting  (10)  into  (A.l)  and  then  integrating  Li  {t)  in  time,  results  in  the  following  expression 


f  Ll  (r)  dT=  f  el  (r)  A^  [f  (r) 

Jto  Jto 


(A.3) 


-C'iSgn(e„  (r))]  dr 


'to 


dr 


del  {t) 

dr 


C'iSgn(e„  (T))dr. 
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After  integrating  the  second  integral  on  the  right-hand  side  of  (A. 3)  by  parts,  the  following  expression  is  obtained 


f  Li  (r)  dT=  f  el  (r)  A^  (r) 
^to  Jto 


to 

-CiSgn  (e„  (r))]  dr  +  el  (r)  V'  (r) 

m 

-^Cu  |e™  (t)||‘^ 

i^l 

=  f  el  (t)  A^  [V-  (t) 

Jta 

-  CiSgn  (e„  (r)) 


-A 


-id-ipir) 


dr 

+el  {t)  Ip  (t)  -  el  {to)  ip  {to) 


dr 


Clide™  {t)\  -  |e„i  (to)|)- 

The  right-hand  side  of  (A. 4)  can  be  upper-bounded  as  follows 

pt  pt 

/  Li{T)dT<  /  ^|e™(r)|A*[|V'i(r)| 

Jta  Jta 


'*0  i=i 

1 

"a 


dOi  (t) 

-  Cl, 

dr 

dr 


+  ^  |e„i  (t)|  (If/'i  (01  “  Cii)  +  C 


&!• 


(A.4) 


(A.5) 


If  Cl  is  chosen  according  to  satisfy  (30),  then  the  first  inequality  in  (A. 2)  can  be  proven  from  (A.5).  The  second 
inequality  in  (A. 2)  can  be  obtained  by  integrating  ^2(0  defined  in  (A.l)  as  follows 


f  L2  (r)  dr 
Jta 


(T)C2Sgn  (e„  (r))dr 


Cb2  ~  C2i  |e„i  (01  <  Cb2- 

i=l 


(A.6) 


Let  the  auxiliary  functions  Pi  {t),  P2  {t)  G  M  be  defined  as  follows 


Pl^C,!-  f  Ll{T)dT 

Jto 

(A.7) 

rt 

P2  =  Cb2  -  /  C2  (t)  dr. 

Jto 

(A.8) 

The  proof  of  Lemma  1  ensures  that  Pi  {t)  and  P2  {t)  are  non-negative.  The  non-negative  function  V  (s  (0  ,  t)  G  R  is 
defined  as  follows 

1^1  1 

V=  -  el e^  +  ^r^Mr  +  Pi  +  P2  +  (A.9) 
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where  s  (t)  £  ]^[("+i)m+2+p]xi  jg  defined  as 


s  = 


VT\  VT^  9 


By  utilizing  (5),  (A. 9)  can  be  bounded®  as  follows 

m  is)  <  V  (s,  t)  <  W2  (s) 

where  Wi  (s),  W2  (s)  £  R  are  defined  as 


(A.IO) 


(A.ll) 


(A.12) 


and  Ai,  A2  (•)  G  R  are  defined  as 
Ai  =  imin{l,TO,  Amin  (r“^)}  , 

A2  =max|l,  im(||s||) ,  ^Amax  (r"^)|  •  (A.13) 

The  time  derivative  of  (A. 9)  can  be  obtained  as  follows 

V  =  +  r^Mf  +  ir^Mr  +  A  +  i^2  +  (A.  14) 

The  first  term  in  the  above  expression  can  be  written  as  follows 


n 

Gi  =  ef  (e2  —  ei)  +  62  (03  —  62  —  ei) 

(e4  -  63  -  62)  +  ... 

—  l  i^n  ^n— 1  ^n— 2)  “t“  Cyj  (t 

n— 1 

=  -  ^  efci  +  eAiSn  +  e^r  -  e^Ae„  (A. 15) 

where  (8a)-(8c),  (10)  where  utilized.  Substituting  (26),  (27),  (A.l),  and  (A. 15)  into  (A. 14)  results  in  the  following 
expression 


n  — 1 

C  =  -  ^  ef  Ci  +  eAie„  +  e^r  -  e^Ae„ 

(  -^Mr  -  en- [K  +  Im)r 
V  +Wre  -  (Cl  +  C2)  Sgn  (e„)  +  TV  +  V- 

+  iAMr  -r'^  [ip-  C'iSgn(e„)) 

+e^C'2Sgn(e„)  -  ~e^Wjr 


(A.16) 


®  Using  (6)  and  (8a)-(8c)  it  can  be  shown  that  || (a;, i, a:*-"  ^^)||  <  il(||s||)  where  •&{■)  is  some  positive  function.  Thus, 
m{x,x,  ...,x^"~^'^)  <  m(||s||). 
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which  can  be  simplified  as  follows 

n—1 

V  =  -'^efei  +  e^_ie„  -  ejAe„  +  eJC'2Sgn(e„) 

+r^(-(i^  +  /™)r-C2Sgn(e„)  +  iv)  (A.17) 

and  utilizing  (10)  results  in  the  following  expression 

n—1 

V  =  -^eJei-  e^Ae„  +  e^_ie„  -  r^r 

+r'^N -r^Kr-elKC2^gn{en).  (A.18) 

By  using  (19),  (29),  and  the  triangle  inequality,  an  upper-bound  on  (A.18)  can  be  obtained  as  follows 

T><-A3||zf +  ||r||p(||z||)||z|| 

m 

-^Ikf -^A,C2.|e™  (t)| 

i=l 

<  -  (as  -  Ikf  -  E  Ie™  (t)|  (A.19) 

where  A3  =  min  {A,  Amin  (A)  —  5}  and  X  G  K.  is  the  minimum  eigenvalue  of  K.  The  following  inequality  can  be 


developed 

m 

T><  W^(s)-EA^C^2^|e™(^)|  (A.20) 

i^l 

where  (5)  G  IR  denotes  the  non-positive  function 

(A.21) 

in  which  /3g  G  K.  is  a  positive  constant,  and  provided  that  if  is  selected  according  to  the  following  sufficient  condition 

K  >  ^^^or  ||z||  <  (2yA^)  .  (A.22) 

Based  on  (A.9)-(A.13)  and  (A.19)-(A.21)  the  regions  D  and  S  can  be  defined  as  follows 

V={s:\\s\\<p-^(2y%K)}  (A.23) 

5=  js  G  P  :  1^2  (s)  <  Ai  (p-i  (2v/A^))^|  .  (A.24) 


Note  that  the  region  of  attraction  in  (A.24)  can  be  made  arbitrarily  large  to  include  any  initial  conditions  by 
increasing  if  (z.e.,  a  semi-global  stability  result).  Specihcally,  (A.  12)  and  (A.24)  can  be  used  to  calculate  the  region 


The  expression  in  (A.20)  can  be  rewritten  as  follows 

V  <  -A^||e„  (t)||, 

where  A  and  ^  G  R  are  the  minimum  eigenvalues  of  A  and  C2,  respectively.  Based  on  the  subsequent  analysis,  it  is  clear  that 
Cn  (t)  G  /Cl. 
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of  attraction  as  follows 


W2{s{h))  <  Ai  (p-1  (2\/A^)) 


A2(N(to)||) 


(2n/a; 


K 


which  can  be  rearranged  as 


K  >  - p- 

-- 


1  2  A2(||s(to)||) 


Ai 


Is  (Mil 


By  utilizing  (20)  and  (A. 10)  the  following  explicit  expression  for  ||s  (to)||  can  be  derived  as  follows 


(A.25) 


(A.26) 


l|s  (to)f  =  E  lie*  (^o)ll'  +  IIM^o)f  +  M  M  +  ll^f  • 


From  (A. 9),  (A. 20),  (A.24)-(A.26),  it  is  clear  that  V  {s,t)  S  Coo  Vs  (to)  S  5  ;  hence  s{t),  z{t),  9  it)  e  Coo 

Vs  (to)  G  S.  From  (A. 20)  it  is  easy  to  prove  that  e„  (t)  G  Ci  Vs  (to)  G  S.  From  (10),  it  is  clear  that  e„  (t)  G  Coo 
Vs  (to)  G  S.  By  using  (6),  (7)  and  (9),  it  can  be  proven  that  a;V)  (t)  e  Coo,  i  =  0,  l,...,n.  Vs  (to)  G  S.  Then,  it  is 
clear  that  M  (t) ,  M  (t) ,  f  (t)  £  Coo  Vs  (to)  G  S.  The  facts  that  r  (t) ,  9  (t)  G  Coo  Vs  (to)  G  S  can  be  used  along  with 


(28)  and  (26)  to  prove  that  9  {t) ,  9  (t)  £  Coo  Vs  (to)  G  S.  After  using  these  boundedness  statements  along  with  (2) 
and  (25),  it  is  clear  that  u{t) ,  u  (t)  G  Coo  Vs  (to)  G  S.  The  previous  boundedness  statements  and  Remarks  1,  2,  3 
can  be  used  along  with  (14),  to  prove  that  f  (t)  G  Coo  Vs  (to)  G  S.  These  boundedness  statements  can  be  used  along 
with  the  time  derivative  of  (A. 21)  to  prove  that  W  (s  (t))  G  Coo  Vs  (to)  G  S;  hence  W  (s  (t))  is  uniformly  continuous. 
Standard  signal  chasing  algorithms  can  be  used  to  prove  that  all  remaining  signals  are  bounded.  A  direct  application 
of  Theorem  8.4  in  [8]  can  be  used  to  prove  that  (t)||  ^  0  as  t  ^  oo  Vs  (to)  G  S.  Based  on  the  definition  of  z  (t),  it 
is  easy  to  show  that  ||ei  (t)||  ,  ||r  (t)||  ^  0  as  t  ^  oo  Vs  (to)  G  5,  t  =  1,  2, ...,  n.  From  (10),  it  is  clear  that  ||e„  (t)||  ^  0 


as  t  — >  oo  Vs  (to)  G  S.  By  utilizing  (9)  recursively  it  can  be  proven  that 
Vs  (to)  G  5.  I 


(i) 


0  as  t  ^  oo,  i  =  1,2,  ...,n 


B  Proof  of  Theorem  2 


PROOF.  The  fact  that  Wr  (t)  is  a  function  of  only  Xr  (t)  and  its  time  derivatives,  can  be  used  along  with  the 
boundedness  requirement  in  (7),  to  show  that  Wr  (t) ,  Wr  (t)  G  Coo-  After  considering  the  fact  that  e„  (t)  G  Ci  (see 
the  proof  of  Theorem  1),  it  is  clear  that  Wj  (t)  Ae„  (t) ,  Wj  (t)  e„  (t)  G  C\.  After  utilizing  this  fact  along  with  the 
first  and  second  terms  in  (24),  we  can  conclude  that  WM  ('^)  (r)  dr  a  and  J)*  Wj  (r)  e„  (r)  dr  C2  as 

t  ^  oo  where  ci,  C2  are  constant  vectors  (see  Theorem  3.1  of  [10]).  Based  on  the  fact  that  e„  (t)  — >  O^xi  as  t  ^  oo 
Vs  (to)  G  S  (see  the  proof  of  Theorem  1)  then  it  is  clear  that  Wr  (t)  e„  (t)  — >  Omxi  as  t  ^  oo.  Utilizing  the  above 
facts  along  with  the  fact  that  Wj"  (to)  e„  (to)  is  constant,  it  follows  that  9  (t)  ^  9oo  as  t  ^  oo.  | 

C  Proof  of  Theorem  3 


PROOF.  Let  V  (s,t)  G  R  denote  the  following  non-negative  function 

1  ”  1 

+  +  +  (C.l) 


Similar  steps  in  [8]  and  [21]  can  be  utilized  to  prove  that  s{t)  £  S  Vt  when  s  (to)  G  S  and  (29),  (30),  and  (A.26)  are  satisfied. 
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where  Pi  (t)  was  defined  in  (A. 7),  Vg  (t)  G  K  is  a  non-negative  function  defined  as 


Jt- 


NJ  (r)  Nr  (t)  dr, 


t-T 


(C.2) 


and  s  (t)  is  defined  as 


A 

s  = 


^/Vg 


iT 


After  utilizing  (5),  (C.l)  can  be  bounded  as  follows 

Wi  (s)  <  V  (s,  t)  <  W2  (s) 

where  Wi  (s),  W2  (s)  G  R  are  defined  by 

,  14^2  (Nil)  ||sf 

and  Ai,  A2  (•)  G  R  are  defined  according  to 


1 


1 


Ai  =  -  min  {1,  m}  ,  A2  =  max  <  1, -m  (||s 


After  taking  the  time  derivative  of  (C.l),  the  following  expression  can  be  obtained 

n—1 

V  —  ^  ^  e*  €^A.Cn  H- 

hr 

rr-t  rji  ^  rrt  /v  /  ,  f~J~' 

—r  r  +  r  N  —  r  Kr - —r  r 


(C.3) 

(C.4) 

(C.5) 

(C.6) 


(C.7) 


where  (8a)-(8c),  (10),  (42),  (44)  and  (A.l)  were  utilized.  After  utilizing  (19),  (29)  and  the  triangle  inequality,  an 
upper-bound  on  (C.7)  can  be  obtained  as 


V<-Xs\\zr  +  \\r\\p{\\z\\)\\z\\-[K+'f]\\r\\ 


<  -  A4  - 


pNNII 


AK 

where  A3  =  min  {  Amin  (A)  —  5}  and  A4  =  min  {A3,  ^}.  The  following  inequality  can  be  developed 

V  <Wis)<  Wis) 

where  W  {s)  ,W  (s)  G  R  denote  the  following  non-positive  functions 

lT(s)^-/3olkf  ,  lT(s)4-/3J|eif 


(C.8) 


(C.9) 


(C.IO) 


with  /3q  G  R  being  a  positive  constant,  and  provided  that  K_  is  selected  according  to  the  following  sufficient  condition 

K  >  ^^^or  Nil  <  (2v/A^)  .  (C.ll) 

Based  on  (C.1)-(C.6)  and  (C.8)-(C.10),  the  regions  D  and  S  can  be  defined  as  follows 


V={s:\\s\\<p-^  (2v^)} 

(C.12) 

5=|sGl?:W'2(s)<Ai(p-i(2\/^))  |. 

(C.13) 
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Note  that  the  region  of  attraction  in  (C.13)  can  be  made  arbitrarily  large  to  include  any  initial  conditions  by 
increasing  if  {i.e.,  a  semi-global  stability  result).  Specifically,  (C.5)  and  (C.13)  can  be  used  to  calculate  the  region 
of  attraction  as  follows 


W2{s{to))  <  Ai  (2y/A^)) 

which  can  be  rearranged  as 


A2(N(to)||) 


—  -  4A4^ 


1  2  A2(||s(to)||) 


Ai 


'(Mil 


By  utilizing  (20)  and  (C.3)  the  following  explicit  expression  for  ||s  (to)||  can  be  derived  as  follows 


(C.14) 


(C.15) 


IIMio)f  =  Elle*  (Mf +  lk(Mf +  C.1. 

i=l 

From  (C.l),  (C.9),  (C.13)-(C.15),  it  is  clear  that  V  (s,  t)  G  £00  Vs  (to)  G  S;  hence  s{t)  ,z  (t)  G  £00  Vs  (to)  G  S.  From 
(10),  it  is  clear  that  e„  (t)  G  £00  Vs  (to)  G  S.  Using  (6)  and  (34),  it  can  be  proved  that  a;V)  (t)  G  £00,  i  =  0, 1,  ...,n. 
Vs  (to)  G  S.  Then,  it  is  clear  that  M  {t)  ,M  (t) ,  f  (t)  G  Coo  Vs  (to)  G  S.  By  using  these  boundedness  statements 
along  with  (2)  it  is  clear  that  u  (t)  G  £00  Vs  (to)  G  S.  These  boundedness  statements  can  be  used  along  with  the 

time  derivative  of  (C.IO)  to  prove  that  W  (s(t))  G  Coo  '^s{to)  G  5;  hence  W  (s(t))  is  uniformly  continuous.  A 
direct  application  of  Theorem  8.4  in  [8]  can  be  used  to  prove  that  ||ei  (t)||  — >  0  as  t  ^  00  Vs  (to)  G  S.  It  should  be 
noted  that  for  finite  time  the  subsequent  analysis  can  be  easily  extended  to  prove  that  Nr  (t) ,  u{t),  r  (t) ,  Nr  (t)  are 
bounded.  | 

D  Development  of  (11)  for  a  second  order  system 

In  this  appendix,  the  open- loop  error  system  in  (11)  is  developed  in  detail  for  a  second  order  system.  Following 
system  model  which  is  a  second  order  form  of  the  class  of  nonlinear  systems  is  considered 

X  =  f  G  {u  di)  d2 

where  x{t),  x{t)  G  K™  are  the  system  states,  f{x,x,9)  G  M™  and  G{x,x,6)  G  are  nonlinear  functions, 

9  G  RP  is  an  unknown  constant  parameter  vector,  di  (t),  d2  (t)  G  are  unknown  additive  nonlinear  disturbances, 
and  u  (t)  G  M'"  is  the  control  input.  The  system  model  is  assumed  to  satisfy  the  following  assumptions. 

Assumption  5  The  nonlinear  function  G  {•)  is  symmetric,  positive  definite  and  satisfies  the  following  inequalities 

V^GR™ 

where  M  {x,x,9)  G  is  defined  as 

M  =  G-^  (D.l) 

and  ru  G  R  is  a  positive  bounding  constant,  ffi  {x,  i)  G  R  is  a  positive,  globally  invertible,  nondecreasing  function  of 
each  variable,  and  H-H  denotes  the  Euclidean  norm. 

Assumption  6  The  nonlinear  functions,  f  (•)  and  G  (•),  are  continuously  differentiable  up  to  their  second  derivatives 

(*.e., /(•),  G(.)gCM 


Assumption  7  The  nonlinear  functions,  /(•)  and  M  (•),  are  affine  in  9. 

Assumption  8  The  additive  disturbances,  di  (t)  and  d2  ft),  are  assumed  to  be  continuously  differentiable  and 
bounded  up  to  their  second  derivatives  (i.e.,  di  ft)  G  and  di  ft),  di  ft),  di  ft)  G  Coo,  i  =  1,  2/ 
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The  output  tracking  error  e\  (t)  G  M™  is  defined  as  follows 


ei  =  Xr  —  X  (D.2) 

where  Xr  (t)  G  is  the  reference  trajectory  satisfying  the  following  property 

Xr  (t)  G  (t)  e  £00  ,  i  =  0, 1, 4.  (D.3) 


The  control  design  objective  is  to  develop  an  adaptive  control  law  that  ensures  ||ei  (t)||  ,  ||ei  (t)||  — >  0  as  t  ^  00  and 
that  all  signals  remain  bounded  within  the  closed-loop  system.  To  achieve  the  control  objectives,  the  subsequent 
development  is  derived  based  on  the  assumption  that  the  system  states  x  (t)  and  x  (t)  are  measurable. 


The  filtered  tracking  error  signal,  denoted  by  62  (t)  G  M™,  is  defined  as  follows 

62  =  61-1-61.  (D.4) 

After  utilizing  (D.l),  the  system  model  can  be  rewritten  as  follows 

Mx  =  h  +  u  +  di  +  Md2  (D.5) 

where  h  (t)  G  is  defined  as  follows 

h  =  Mf.  (D.6) 

To  facilitate  the  control  development,  the  filtered  tracking  error  signal,  denoted  by  r  (t)  G  M™,  is  defined  as  follows 

r  =  62  -I-  Ae2  (D.7) 

where  A  G  ig  a  constant,  diagonal,  positive  definite,  gain  matrix.  After  differentiating  (D.7)  following  expres¬ 

sion  is  obtained 

r  =  62  -I-  Ae2  (D.8) 

=  e'l -I- 61 -I- Ae2  (D.9) 

=  X  r  —  ^  -t-  61  -t-  A62  (D.IO) 


where  second  time  derivative  of  (D.4),  and  third  time  derivative  of  (D.2)  were  utilized  to  obtain  the  second  and  third 
equations,  respectively.  The  time  derivative  of  the  expression  in  (D.5)  is  as  follows 


M  X  didx  —  h  -\~  ii  ~\~  d\  -\~  didd2  ~\~  A7(i2  (^■^^) 

and  the  following  expression  is  obtained 

Af  X  =  — M X  h  ii  di  A7d2  -t-  Md2-  (^■^^) 

After  premultiplying  (D.IO)  by  M  (•)  following  expression  is  obtained 

Mr  =  M'Xr  —  Mx  +  Mei  +  MAe2  (D.13) 

and  then  substituting  (D.12)  results  in  the  following  expression 

Mf  =  Mx'r  +  Mei  +  MAe2  -|-  Mx  —  h  —  u  —  di  —  Md2  —  Md2  (D-14) 

=  M  (x'r  -|-  61  -I-  Ae2)  -I-  Mx  —  h  —  ii  —  di  —  Md2  —  Md2-  (D.15) 


It  is  noted  that  (D.15)  is  the  second  order  form  of  the  general  expression  in  (11). 
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E  Detailed  explanation  of  the  system  model  in  the  simulation  study 


In  this  appendix,  the  system  model  utilized  in  the  simulation  study  is  presented  in  detail.  The  system  model  that 
was  considered  in  the  simulation  study  is  a  first  order  form  of  the  class  of  nonlinear  systems  considered  in  this  work 
and  has  the  following  form 

X  =  f  +  G  (m  +  c?i)  +  d2  (E.l) 

iT 


where  x  (t)  = 


Xl  (t)  X2  (t) 


are  nonlinear  functions,  0  = 


€  is  the  system  state,  u  {t)  G  is  the  control  input,  /  (x,  9)  G  and  G  (x,  6)  G 
tT 


n  <72 


is  a  constant  parameter  vector,  di  (t),  d2  (t)  G  are  additive 


nonlinear  disturbances,  and  /  {x,  9)  and  G  {x,  9)  are  defined  as  follows 


/  = 


G  = 


XiX2 


2  +  cosa^i 


9i 


0 


0 

3  +  sin  X2 
^2 


The  matrix  inverse  of  G  {x,  0),  denoted  by  M  {x,  9)  G  is  defined  as 

0 


M  = 


2  +  cosxi 
0 


02 


3  +  sin  X2  . 

The  output  tracking  error,  denoted  by  ei  (t)  G  R^,  is  defined  as  follows 

ei  =  Xr  —  X 

where  Xr  {t)  G  is  the  reference  trajectory  selected  as 


Xr  = 


Xrl 

Xr2 


Sin  i  1  —  exp  —  — 

5 

(  f  t'" 

2  sin  t  1  1  ~  exp  1  ~  ^ 


After  utilizing  M  (•)  =  G~^  (•)  the  system  model  can  be  rewritten  as  follows 

Mx  =  h  +  u  +  di  +  Md2 

where  h  (t)  G  R^  is  defined  as  follows 

h  =  Mf. 

The  time  derivative  of  the  expression  in  (E.7)  is  given  as  follows 

Ad X  Ad X  =  ii  u  di  Ald2  ~\~  Add2- 


(E.2) 

(E.3) 


(E.4) 


(E.5) 


(E.6) 


(E.7) 

(E.8) 

(E.9) 


Since  a  first  order  system  model  was  preferred  for  the  numerical  simulation  study,  the  only  filtered  tracking  error 
signal,  denoted  by  r  (t)  G  R^,  is  defined  as  follows 


r  =  ei  +  Aei 


(E.IO) 


where  A  G  R^^^  is  a  constant,  diagonal,  positive  definite,  gain  matrix.  After  differentiating  (E.IO)  following  expression 
is  obtained 


r  =  ei  +  Aei 
=  Xr  —  X  +  Aei 


(E.ll) 

(E.12) 
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where  the  second  time  derivative  of  (E.5)  was  utilized.  After  premultiplying  (E.12)  with  M  (•),  following  expression 
is  obtained 

Mr  =  Mxr  —  Mx  +  M  Kei  (E.13) 

and  then  substituting  (E.9)  results  in  the  following  expression 

Mr  =  Mxr  +  Mx  —  h  —  u  —  di  —  Md2  —  Md2  +  MAei.  (E.14) 

After  adding  and  subtracting  0.5M  (•)  r  (t)  +  ei  (t)  to  the  right-hand-side  of  (E.14)  following  expression  is  obtained 
Mr  =  Mxr  +  Mx  —  h  —  u  —  di  —  Md2  —  Md2  +  MAei  +  O.bMr  —  0.5Mr  +  ei  —  ei.  (E.15) 

The  auxiliary  signal,  denoted  by  A^  (•)  €  is  defined  as  follows 

N  =  Miir  +  Aei)  +Mix  +  0.5r)  +  ei  -  h  (E.16) 

and  the  auxiliary  signal,  denoted  by  Nr  (t)  €  ,  is  defined  as  follows 


Nr  =  MrXr  +  MrXr  ~ 


hr  =  Mrfr- 


where  hr  (t)  G  is  defined  as  follows 
The  nonlinear  functions  Mr  (t)  and  fr  (t)  are  functions  of  reference  trajectory  and  are  defined  as  follows 

0 


Mr  = 


2  -I-  COSXri 

0 


3  -I-  sin  Xr2 


(E.17) 

(E.18) 

(E.19) 


fr  = 


Xr2 


The  auxiliary  signal  Nr  (t)  can  be  found  as  follows 

1 


Nr  = 


0i 


2  -I-  cos  Xrl 
0  02- 


0 


1 


1  _ 

Xrl 

Xr2 

-h 


-01 


Xrl  SinXrl 

(2  -I-  cosa;ri)^ 


-01 


Xrl  SinXri 

(2  -I-  cosxri)^ 

0 


1 


Xr2  cos  Xr2 

(3  -I-  sina;r2)^  J 

0 

X’p2  cos 
(3  -I-  sinxrf)^ 


Xrl 

Xr2 


Xj'XXf^ 

Xr2 


2  -I-  cos  Xrl 
0  02: 


0 


1 


XrlXr2  4”  XrlXr2 
2Xr2^r2 


01 


'  3  -I-  sin  Xr2 

^  .  ...  .  ' 

Xf^^.  X‘p2.X'f'2  Xj‘\Xf2  X'p']^  X'p^X'f'^'^  Sin 

^  2  -I- cos  Xrl  (2  -I- COS  Xrl 

f  Xr2  2Xr2Xr2  (^r2  ^r2^  COS  Xr2  ^ 


3  -I-  sinxr2 


(3  -I-  sinxr2)^ 


(E.20) 


(E.21) 
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From  which  it  can  be  concluded  that 


Nr  =  Wr9 


where  9  = 


01  09 


is  the  unknown  constant  parameter  vector  and  Wr  {xr,  Xr-,  Xr)  G  is  the  nonlinear 


regressor  matrix  dehned  as  follows 


Wr  = 


2  +  COSXri 


Xrl  (Xrl  —  XrlXr2)  SinCCrl 
(2  +  COS  Xrlf 


0 


Xr‘2  ‘^Xr'lXrl 

3  +  sinxr2 


0 

Xr2  {Xr2  —  2:^2)  COS  Xr.2 

(3  +  sinxr2)^ 


F  Development  of  (19) 

In  this  appendix,  the  upper  bound  for  the  auxiliary  term  N  (.)  in  ((19))  will  be  derived.  To  facilitate  the  upper 
bound  development,  hrst,  the  second  and  the  third  terms  in  the  first  line  of  (13)  will  be  written  in  terms  of  (t), 
1=1,  After  utilizing  (8a)  and  (8b),  following  expressions  can  be  obtained  for  the  first  and  the  second  time 
derivatives  of  ei  (t) 


61  =  62-61  (F.l) 

61  =  63  —  2e2  (F-2) 

and  the  following  general  formula  can  be  utilized  to  calculate  the  higher  order  derivatives  of  ei  (t)  in  terms  of  (t), 

1=1, ...,  n 


e 


(fc) 

1 


afejOCfc+i  +  OfepCfc  +  afc_26fc-i 
k-2 

T  ^  ^  (  ^k  —  l,i  a^  —  iy+l  U/e— 1,1+2) 

i=l 


(F.3) 


for  k  =  3, (n  —  1),  and  the  n*''  order  derivative  of  ei  (t)  can  be  obtained  as  follows  in  terms  of  Ci  (t),  i  =  1,  ■■■,n 
and  r  (t) 

61"^  =  r  -  [(d„,o  +  dn,i)  /  -  A]  e„  +  (d„,o  +  an, 2)  e„-i 

n—2 

+  (— dn-1,1  —  d„_i,i+i  +  d„_i,i+2)  Cn-i-i  (F-4) 

1=1 


where  ak,o  =  1,  afc,i  =  —k,  ak,2  =  (k  —  1)  {k  —  2)  /2  for  k  =  2,  ...,n  and  ak,j  =  0  when  j  >  k.  After  utilizing  (F.3) 
and  (F.4)  along  with  (13),  following  expression  can  be  obtained 

n—2  n—1 

+  Ae„  =  bjCj  +  Aie„  +  A2r  (F.5) 

j=o  j=l 


where  bj,  j  =  1, ...,  (n  —  1)  are  constants,  and  Ai,  A2  G  are  constant,  diagonal  matrices  that  can  be  obtained 

by  substituting  (F.1)-(F.4)  into  the  left-hand-side  of  (F.5).  Thus,  the  auxiliary  function  N  (^x,x,  which 

was  dehned  in  (13),  can  be  rewritten  as  follows 


N  =  M 


bjCj  +  Aie„  -I-  A2r^ 


+  M 


+  Cn  —  h. 


The  auxiliary  function  Nr  (t)  can  be  written  as  follows 

Nr  =  -b  Mrxi^'^  -  hr 


(F.6) 


(F.7) 
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where  Mr  (t)  was  defined  in  (18)  and  hr  {t)  G  M™  is  defined  as  follows 


To  simplify  the  subsequent  derivations,  following  definitions  are  made 


F  =  N  -  Md2  -  Md2 
Fr  =  Nr  —  Mrd2  —  Mrd2 


where  F  =  F 


(x,..., 


(n)  (’^+1) 


)  G  M”"  and  Fr  =  Fj 


X  —  Xr,  X=Xr 


c(^)— 


=  F 


\  Thus,  from  (15)  following  expression  is  obtained 


^Xr, ...,  a;r"\  0, ...,  0,  0, 


N  =  F-  Fr. 


(F.8) 


To  further  facilitate  the  subsequent  upper  bound  development,  F  (^Xr,  x,  a;^”\  ei, e„,  r,  x 


(n+l) 


F  {  Xr,Xr,  ■ 


(n) 


,  ei,  ...,e„,r, ,  F  (^Xr,  ...,xi"'\o, ..., e„, r, F  (^Xr,  ...,a;r"'\  0, ...,  0,r,  are  added 


and  subtracted  to  the  right-hand  side  of  (F.8)  to  obtain  the  following  expression 


N  = 


(x, x^"‘\ei, e„,  r,  -  F  (xr,  ■■■,  x^"‘\ei, e„,  r, 

F  -  F  (xr, 


X  Nn)  Nn+1) 

0/7-,  ...,0/  ,0X7...,  C-77, ,  /  , 


F  (t  ^("-1)  rrM  p,  p  r  —  F  ( 'r  -rl")  p,  p  r 

±  I  Oz-p,  ,0/  ,  c-x  ,  c-77, ,  /  ,  I  i  I  O/T-,  5*^7'  7 5  •  ••  5 1  •^r 

f(t  rpin-l)  (n)  .,.("+1)')  —  f(t  n  P  r 

±  I  Oz-r,  )  ‘^7’  5  '^1  5  ••  *5  5  '  5  *^7'  j  ^  I  UzT*,  Oz^  ,  U ,  . . . ,  077 ,  /  ,  Uz.^  I 

F  (^a;r,...,a;^.”\0,e2,...,e„,r,a;^”+^^^  -  F’  ...,  a;^”\  0,  0, ...,  e„,  r, 


(xr, ...,  4"^  0. 0,  0,  r,  -  F  ...,  xi’^\0, 0, ...,  0,  0, 


(F.9) 


It  is  to  be  noted  that  the  first  term  on  the  first  line  of  (F.9)  and  the  second  term  on  the  last  line  of  (F.9)  are  equal 
to  F  (•)  and  Fr  (•),  respectively,  and  the  other  terms  are  subtracted  in  the  preceding  line  and  added  in  the  following 
line.  After  applying  the  Mean  Value  Theorem  [8]  to  each  bracketed  term  of  (F.9),  the  following  expression  can  be 


23 


obtained 


N  = 


dF  (^CTo, ei, e„,  r, 


dan 


(x  —  Xr) 


dF  (xr,  CTi, ...,  a;(”\  ei, ...,  e„,  r, 


da  I 


(x  —  Xr) 


dF  (^Xr, ...,  an,  61,62, 


dan 


-  4”^) 


,  Xr  I  O’n-^h  ^2 5  •••5  ^ni  ^  1 


da 


n+l 


‘~\T^  (  (^)  (^+1) 

dF  f  Xr,  %  ei,  an+2,  ■■■,  en,  r, 


(ei  -0) 


^  n  +  l  — 'dn-\-l 


da 


n+2 


(62  -  0) 


<^n  +  2—'dn  +  2 


r\T^  (  in)  (n+l) 

at  (Xr,...,Xf  ',ei,e2,...,fT2n,Fa:f 


da 


2n 


r\T^  (  in)  (n+l) 

dFfxr,...,x^  ',ei,e2,...,en,a2n+i,a^r 


(e„  -  0) 


aa 


2n+l 


(r-0) 


<72n  +  l— 'i^2n  +  l 


(F.IO) 
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where  Vi  G  (xr,  x)  for  f  =  0, n,  Vi  G  (0,  e^)  for  i  =  (n  +  1) , 2n,  and  W2n+i  G  (0,  r).  The  right-hand  side  of  (F.IO) 
can  be  upper  bounded  as  follows 


N 


< 


dF 


(o-Q,... 


frj'l  ("^+1) 


ScTn 


dF  (xr,  (Ji, a;(”\  ei, e„,  r, 


|ei| 


9cti 


|ei| 


dF 


^Xr, 


;  Cl ,  €2  5  ■  ■■  5  Cyj ,  r,  X 


("+1) 


(")  ("+1) 
xl-  b(j„+i,e2,...,e„,r,  xl- 


9(T„+i 

{  (?i)  (n+1) \ 

dF  \xr, -.jX^r  bei,(T„+2,...,e„,r,  xl-  M 


n+2 


<^n  +  l  — "^71  + 1 


(Tn^2—Vn 


|ei| 


16211 


dF 


i^r-)  ■■■? 


(n)  (^+1) 

Xr  Sei,e2,...,cJ2n,r,a:^ 


2n 


f  (n)  (n+l)\ 

dF(xr,...,x^  %ei,e2,...,en,a2n+i,a:^  M 


2n+l 


'72T1.  +  1— '^271  +  1 


(F.ll) 


The  partial  derivatives  in  (F.ll)  can  be  calculated  by  using  (F.6)  as  follows 


n  — 1 


^  +  E  fx(”)  -P  ir)  -  for  *  =  0, ...,  n 


Sa*  ScTi 


i=i 


5(71 


(F.12) 


aF  (cTj) 
dai 


=  for  7  =  (n  +  1) , ...,  (2n  —  1) 


aF  ((T2„) 

d(J2n 

dF  (ct2„+i) 


=  MAi  +  / 


5(7^ 


=  MA2  +  0.5M. 


2n+l 


(F.13) 

(F.14) 

(F.15) 


By  defining  Vi  =  x^^^  —  Ti  ^x^*)  —  Xr  for  i  =  0, ...,  n,  Vi  =  ei  —  ti  (ci  —  0)  for  i  =  (n  +  1) , ...,  2n,  and  V2n+i  — 

r  —  Ti{r  —  0),  where  ti  G  (0, 1)  Vi  =  0, ...,  (2n  +  1),  and  if  Assumptions  2  and  4,  and  (7)  are  met,  then  upper  bounds 
for  the  right-hand  sides  of  the  expressions  in  (F.12)-(F.15)  can  be  rewritten  as  follows 


dF{ai) 


dai 


^  P^  (x,...,x(”)) 


(F.16) 
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where  (•)  Vi  =  0, (2n  +  1),  are  positive  nondecreasing  functions  of  x  (t) , (t).  After  substituting  (F.16) 
into  (F.ll),  the  upper  bound  for  the  auxiliary  signal  N  {■)  can  be  rewritten  as 


j=0 


So) 


2n 


+  ^  p,.(||ei||,...,||e„|M|r||)||e,_. 

j=n+l 

+d2„+i(l|ei||,...,||e„||,||r||)||r|| 


(F.17) 


where  (F.1)-(F.4)  and  derivatives  of  (6)  were  utilized.  The  expressions  in  (20),  (F.1)-(F.4)  can  be  used  to  rewrite 
the  upper  bound  for  the  right-hand  side  of  (F.17)  as  in  (19). 
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